The Armenian leaders were discussing the contested region of Nagorno-Karabakh between them and Azerbaijan.
Russia has maintained peacekeepers in the region since a 2020 war in which Azerbaijan seized back significant amounts of territory it had lost to Armenian forces in the 1990s.
In recent months, Russia has publicly backed Azerbaijan's claim to Nagorno-Karabakh and blamed Armenia for the ongoing blockade of separatist-held Karabakh.
A group of Israeli academics and activists have implored President Herzog to intervene in the Nagorno-Karabakh conflict between Armenia and Azerbaijan.
The two sides have since been discussing a peace deal in which they would agree on borders, settle differences over the enclave, and unfreeze relations.
Armenia and Azerbaijan have fought two wars in the past 30 years over Nagorno-Karabakh.
The main corridor connecting Armenia and the Nagorno-Karabakh region has been restricted or blocked since December.
As South Azerbaijani dissident Babek Chalabi noted, the world needs to "break free from Iran's nurturing of terrorism."
During his visit to Azerbaijan, Defense Minister Gallant spoke about Iran't attempted attacks on Jews around the world and threat Iran poses to the Middle East.
Numerous global media reports have assessed that Israeli intelligence forces have used the porous Iran-Azerbaijan border for operations.